Overhead camera synchronization

ABSTRACT

Various embodiments herein each include at least one of systems, devices, methods, and software for overhead camera synchronization, such as with regard to a camera positioned above a POS terminal or other kiosk terminal type. One embodiment in the form of a method includes adjusting at least one of an exposure setting of an imaging device and lighting within a field of view of the imaging device to affect an exposure within an image captured by the imaging device. This method further includes capturing an image with the imaging device with the at least one of the exposure setting of the imaging device and the lighting within the field of view of the imaging device to achieve a desired exposure within the captured image.

BACKGROUND INFORMATION

Point-of-Sale (POS) terminals have become reliant on imaging device, orcamera, based barcode reading. But the presence of cameras has alsogiven rise to further demands for images captured thereby for what isbecoming many purposes. As a result, imaging is creating significantdemands at POS terminals for processing capability. At the same time,different processes that receive and process images may desire orrequire different image parameters or properties, such as with regard toillumination, resolution, image size, and the like. While certainparameters and properties may be manipulated from virtually any capturedimage, others may not be.

SUMMARY

Various embodiments herein each include at least one of systems,devices, methods, and software for overhead camera synchronization, suchas with regard to a camera positioned above a POS terminal or otherkiosk terminal type.

One embodiment in the form of a method includes adjusting at least oneof an exposure setting of an imaging device and lighting within a fieldof view of the imaging device to affect an exposure within an imagecaptured by the imaging device. This method further includes capturingan image with the imaging device with the at least one of the exposuresetting of the imaging device and the lighting within the field of viewof the imaging device to achieve a desired exposure within the capturedimage.

Another embodiment, in the form of a system, includes a product scannerincluding at least one imaging device and a light-field that illuminatesa scan-area. The system further includes an overhead imaging device tobe positioned to provide an overhead view of the scan-area of theproduct scanner and a control module that controls operation of theproduct scanner and the overhead imaging device by performing dataprocessing activities. The data processing activities of the controlmodule may include adjusting at least one of an exposure setting of theoverhead imaging device and lighting of the product scanner light-fieldto affect an exposure within an image captured by the overhead imagingdevice. The data processing activities may further include capturing animage with the overhead imaging device with the at least one of theexposure setting of the overhead imaging device and the lightingproduced by the product scanner light-field to achieve a desiredexposure within the captured image.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is a logical block diagram of a system including a scanner,according to an example embodiment.

FIG. 2 is a diagram illustrating components of a scanner that may bedeployed at a checkout station such as a POS terminal, self-serviceterminal (SST), or other kiosk system including a scanner, according toan example embodiment.

FIG. 3 includes two series of images captured by an imagining devicewith lighting and exposure setting manipulations, conventionally andaccording to an example embodiment.

FIG. 4 includes a series of images captured by an imaging device withlighting and exposure settings as illustrated.

FIG. 5 is a logical block flow diagram of a method, according to anexample embodiment.

FIG. 6 is a block diagram of a computing device, according to an exampleembodiment.

DETAILED DESCRIPTION

Various embodiments herein each include at least one of systems,devices, methods, and software for overhead camera synchronization, suchas with regard to a camera positioned above a POS terminal or otherkiosk terminal type.

Many applications exist and more are being developed for POS and kioskterminals (e.g., teller assisted and self-service terminals) thatutilize an external overhead-view camera situated above a work area,such as over a scan-field of a product scanner. Such an overhead cameramay be, for example, a remote video-over-Ethernet camera, USB camera,and the like. Images from the camera may be used for various purposessuch as automated fraud and theft detection, security monitoring andrecording, teller assistance in identifying presented items such asproduce, and the like. Unfortunately, product scanners often broadcastintense pulsed illumination to improve conditions for scanning withimaging devices that disrupts conventional overhead cameras. Suchintense pulsed illumination renders overhead cameras virtually uselessfor most applications as the images are often under or over exposed andcertainly not consistent between frames to enable utilization for manypurposes. The various embodiments herein include systems, method,devices, and software to eliminate this disruption by synchronizing theoverhead camera with the illumination in the work area, such as within ascan-field of an imaging scanner.

These and other embodiments are described herein with reference to thefigures.

In the following detailed description, reference is made to theaccompanying drawings that form a part hereof, and in which is shown byway of illustration specific embodiments in which the inventive subjectmatter may be practiced. These embodiments are described in sufficientdetail to enable those skilled in the art to practice them, and it is tobe understood that other embodiments may be utilized and thatstructural, logical, and electrical changes may be made withoutdeparting from the scope of the inventive subject matter. Suchembodiments of the inventive subject matter may be referred to,individually and/or collectively, herein by the term “invention” merelyfor convenience and without intending to voluntarily limit the scope ofthis application to any single invention or inventive concept if morethan one is in fact disclosed.

The following description is, therefore, not to be taken in a limitedsense, and the scope of the inventive subject matter is defined by theappended claims.

The functions or algorithms described herein are implemented inhardware, software or a combination of software and hardware in oneembodiment. The software comprises computer executable instructionsstored on computer readable media such as memory or other type ofstorage devices. Further, described functions may correspond to modules,which may be software, hardware, firmware, or any combination thereof.Multiple functions are performed in one or more modules as desired, andthe embodiments described are merely examples. The software is executedon a digital signal processor, ASIC, microprocessor, or other type ofprocessor operating on a system, such as a personal computer, server, arouter, or other device capable of processing data including networkinterconnection devices.

Some embodiments implement the functions in two or more specificinterconnected hardware modules or devices with related control and datasignals communicated between and through the modules, or as portions ofan application-specific integrated circuit. Thus, the exemplary processflow is applicable to software, firmware, and hardware implementations.

FIG. 1 is a logical block diagram of a system 100 including a scanner,according to an example embodiment. The system 100 is an example ofdeployment in a retail environment, although the various embodimentsherein are also applicable to other environments, such as customerservice kiosks and library checkouts, travel check-in kiosks, amongothers.

The system 100 includes a scanner 102 coupled to a terminal 104. Thescanner 102 may be a product scanner or similar scanning device in someembodiments. An example of such a scanner is the REALSCAN 7879 BI-OPTICIMAGER available from NCR Corporation of Duluth, Ga. Such modernscanners utilize one or more cameras in performing their scanningfunctions. Some such scanners even have four or more cameras includedtherein. Additional cameras may also be coupled to or otherwise be incommunication with the scanner 102 or the terminal 104, such as a camerathat may be mounted on a pole on the ceiling to provide an overhead viewof one or both of the terminal 104 and scanner 102 areas. As such, thesecameras may be utilized to capture images of many things including itemspresented for scanning or weighing, an area around the terminal, acashier at the terminal 104 or a neighboring terminal, customers at theterminal 104 or in line, and other areas.

The terminal 104 may be a modern cash register serviced by a checkoutclerk or cashier, or it can be a self-checkout terminal or otherSelf-Service Terminal (SST), customer service kiosk, and the like. Insome embodiments, the scanner 102 is coupled, via either wired orwireless connections, to one or more additional cameras, such as cameras106, 108. However, various embodiments may include one camera, three,four, and even more cameras. In some embodiments, the camera 106 may bepointed in the direction of a customer presenting items to purchase anddocuments to complete a purchase transaction at the terminal 104.Similarly, the camera 108 may be pointed in the direction of a terminal104 clerk. Other cameras, such as cameras integrated within the scanner102 may be directed toward a scan field of the scanner 102 to captureimages of barcodes, watermarks embedded within product packaging (e.g.,DIGIMARC), and the environment around the scanner 102 and terminal 104.

The system 100 also typically includes a network 110 that connects oneor both of the scanner 102 and the terminal 104 to other computingdevices. The other computing devices may include one or more transactionprocessing systems 114, one or more databases 112 that may storetransaction, product, and other related data, depending on theparticular embodiment. The network 110 may also provide a connection toa security video-over-Ethernet storage, viewing, and monitoring systemthat receives images and video from the cameras 106, 108 and the scanner102 cameras deployed at the terminal 104.

FIG. 2 is a diagram illustrating components of a scanner 208 that may bedeployed at a checkout station such as a POS terminal, self-serviceterminal (SST), or other kiosk system including a scanner 208, accordingto an example embodiment. It is to be noted that the scanner 208 isshown schematically in greatly simplified form, with example componentsrelevant to understanding various embodiments herein. Note that thescanner 208 may include more or fewer components in some embodiments.

Furthermore, the various components included in the FIG. 2 asillustrated and arranged are provided for illustration purposes only. Itis to be noted that other arrangements with more or fewer components arepossible without departing from the contributions herein.

Moreover, the methods and scanner 208 presented herein and below mayinclude all or some combination of the components described and shown inthe various contexts herein. Further, although the scanner 208 may bepaired with a POS terminal, the scanner 208 may be a standalone elementor an element of other systems, devices, and terminals in otherembodiments. Examples of other terminal-types that may include a scanner208 are SSTs, clerk operated and self-service library checkout stations,time-keeping terminals, and the like. Additionally, although a scanneris illustrated in FIG. 2 according to some embodiments, the in-scannerimage sorting and processing described herein may also be implementedwith regard to images and video streams generated by other devices, suchas standalone cameras, such as one or more of cameras 240, 242 that maybe coupled either directly or indirectly via USB or a network to thescanner 208.

The methods of some embodiments are programmed as executableinstructions in memory and/or non-transitory computer-readable storagemedia and executed on one or more processors associated with thecomponents and devices herein. For example, some embodiments may bedeployed as firmware present within the scanner 208, such as firmware226. In other embodiments, the in-scanner image sorting and processingfunctions may be deployed as software on the scanner or network deployedservice accessible by the scanner. In other embodiments, the imagesorting and processing may be performed on a computer controlling a POSterminal to which the scanner 208 is coupled, on a network server, or ona combination of two or more of the scanner 208, the computercontrolling the POS terminal to which the scanner 208 is coupled.

The scanner 208 may be referred to herein as a product scanner orbarcode scanner as that is the task most commonly associated with suchdevices. During operation, items are placed within a scan field of thescanner 208. One or more imaging devices 218 of the scanner 208, such asone or more cameras, then scan a barcode and information read therefromis communicated to a POS system. The POS system then uses that data toidentify the item placed within the scan field of the scanner 208 andperforms an additional function. The additional function may include aprice lookup and addition of the item to a list of items to bepurchased, which may be presented on the one or more POS displays. Theadditional function may also include identifying a scanned product as acontrolled item for which an age, identity, and/or address validationmust be performed. A message may be presented on the one or more POSdisplays and a message may also be sent to the scanner 208 indicating anidentification card or other document is to be scanned. Other additionalfunctions may also be performed in different embodiments.

The scanner 208 may include one or more scan fields, such as two scanfields of bi-optic scanners that are commonly seen in grocery anddiscount retail outlets. In addition to the imaging devices 218, thescanner 208 may include various other components. The various othercomponents may include an integrated scale 210 such as may be used in agrocery outlet to weigh produce and one or both of a speaker 212 anddisplay lighting 216 to output audio and visual signals such as signalsof (un)successful scans. The scanner 208 may also include scan fieldlighting 220 that may be turned on and off and adjusted based on adetected presence of an item to be scanned. The scan field lighting 220may include one, two, or more different light colors, such as white,red, green, infrared, and possibly others. Additionally, scan fieldlighting 220 may be of variable intensity or brightness in someembodiments and be varied by applying different electric potentials tothe lighting elements or adjusting a number of lighting elements, suchas LEDs, that are illuminated.

During typical operation, the scanner 208 is operated according toinstructions executed on a processor 222. The processor 222 may be anapplication specific integrated circuit (ASIC), a field programmablegate array (FPGA), digital signal processor, microprocessor, or othertype of processor. The instructions may be firmware 226 or software 230stored in one or more memories 224. The one or more memories 224 may beor include volatile and non-volatile memories, write-protected memories,write-once memories, random access memory (RAM), read only memories(ROM), secure memory, and other memory and data storage types anddevices.

The instructions as may be stored in firmware 226 or as software 230 inmemory 224 are executed according configuration settings stored in thememory 224. The configuration settings 228 configure operation of thescanner 208 and the various components therein. For example, theconfiguration settings 208 may configure speaker 212 volume, displaylighting 216 outputs, and scan field lighting 220 brightness. Theconfiguration settings may also configure decoding algorithms of theimaging device(s) 218 and the instructions, one or more communicationprotocols used to communicate data from the scanner 208 to a POS systemor other system via wired or wireless connections, and scale 210operating parameters (e.g., unit of measure as pounds or kilograms). Theconfiguration settings may also configure other settings of theparticular scanner 208 an embodiment may include. In some embodiments,the configuration settings 228 may include a firmware version, asoftware version, and the like. Thus, when a configuration is set orupdated, the setting or updating of the configuration settings 228 mayinclude population and updates of any of the configuration settings 228of a particular embodiment, including an update to firmware and softwarepresent on the scanner.

The scanner 208 may include one or more communication interfaces 214,232 that enable the scanner 208 to communicate via one or both of wiredand wireless connections over a network and with other computingdevices. In some embodiments, the communication interface 232 mayprovide a virtualized communication connection on the scanner 208 thatenables the scanner to communicate over a network leveraging networkconnectivity of a terminal or other computing device with which thescanner is paired, such as a POS terminal.

During operation, the one or more imaging devices 218 of the scanner 208capture images, such as still images and frames of video. These stillimages and video may be stored within the memory 224 or other datastorage device of the scanner 208, a terminal or other device pairedtherewith, or transmitted via one of the communication interface 214,232 over a network. In other embodiments, the video is simply capturedand processed on the scanner 208 and discarded. However, in somecircumstances, certain images are needed, such as images of documentspresented for payment, identity verification, for security videorecording (e.g., ONVIF video-over-Ethernet, UVC over USB) and the like.In such instances, these images are processed according to instructionsstored in software 230, firmware 226, or by passing such images to POSterminal controlling computer or a network service via one of thecommunication interface 214, 232 for appropriate processing.

In some embodiments, the scanner 208 includes four internal imagingdevices 218 and a remote customer scanner (RCS) that communicates withthe scanner 208 over a wire or wirelessly. The scanner 208 may beconnected to a POS terminal via USB and to an ONVIF NVR (network videorecorder) via the communication interface 214 to an Ethernet network.

The processing in some embodiments, from a general perspective, includesthe scanner 208 imaging devices 218 and other cameras 240, 242 capturingimages utilizing a diversity of camera exposure, illumination,resolution, cropping, color modes, positions, and times. The software230 or firmware 226 of the scanner may then process and sort thediversity of images to suit each of a number of desired services.Optionally, to reduce processing load, the scanner 208 may process andsort images in a centralized task to minimize duplication of processor222 usage. The scanner 208 then presents the processed and sorted imagesto each of the desired services for further action.

In some such embodiments, the scanner 208 captures images utilizing adiversity of camera 218, 240, 242 exposure, illumination, resolution,cropping, color modes, position, and time. In some such embodiments, acamera 218, 240, 242 control process communicates with the cameras 218,240, 242, for example by 12C interface, to control and coordinateindividual camera 218, 240, 242 behaviors. Also, the different cameras218, 240, 242 can be color or monochrome, or include a variable outputoption that allows one or more of the cameras 218, 240, 242 to output acolor or monochrome image.

Time diversity in some embodiments may be periodic or event driven, suchas upon detection of an event by a scanner 208 process, such as movementin a camera 218, 240, 242 field of view after a POS terminal or thescanner 208 entering an idle state.

In some embodiments, the scanner 208 processes and sorts the diversityof images to suit each of the desired scanner services. Processing andsorting can be done in software 230, firmware 226 that may reside on thescanner 208, on a connected POS terminal, on a server, or on a hybridcombination. In some embodiments, the processing of the images mayinclude one, two, or more, among others, for reducing resolution, forexample using a pyramid filter, adjusting color, for example altering orapplying white balance, separating colors, for example by applying ade-Bayer filter, and adjusting brightness or contrast. The processingmay also include one or more of applying a region-of-interest orframe-of-interest filter, to flag frames containing a 1D barcode, 2Dbarcode, or some other item of interest, detecting motion, detectingitem substitution, detecting and removing image portions, such as abackground and hand and arms of a cashier included in an image, andother processing.

In these and some other embodiments, the scanner 208 may sort images byevaluating metadata associated with each image. The metadata may bestored in memory in image headers. Metadata for sorting purposes mayinclude camera source and location, exposure parameters, illumination,for example on/off or red/white, camera type (e.g., color ormonochrome), image type (e.g., color or monochrome), resolution (e.g.,1280×960, 640×480, 320×240 and color or monochrome pixels), cropping(e.g., the region of interest around a one-dimensional barcode), time,and previous image processing results (e.g., one-dimensional frame ofinterest, two-dimensional frame of interest, motion detected, etc.).

In some embodiments, the scanner 208 can further sort images accordingto target frame rates. For example, if the target processing serviceneeds a fixed frame rate of four frames per second, the scanner 208 canuse a timer to only select one image every 0.25 seconds.

Some embodiments may also reduce processor 222 load by processing andsorting images in a centralized task to minimize duplication ofprocessor 222 usage for the same task. For example, if a UNCI videostreaming process needs 640×480 black & white images at a rate ofsixteen frames per second, and an ONVIF video-over-Ethernet serviceneeds 640×480 black & white images at a rate of 4 frames per second, thecentralized task will process images at the 16 frame per second for theUVC process, and provide every fourth frame to the ONVIF process.

In some further embodiments, the scanner 208 presents the processed andsorted images to each of the desired services for further action. Theseservices may include one or more of, among others, reading one and twodimensional barcodes on printed paper, products, and mobile devices(e.g., smartphones, smartwatches, tablets, etc.), reading DIGIMARCcodes, detecting fraud situations (e.g., item substitution fraud),identifying produce for picklist reduction algorithms, providingvideo-over-USB (UVC) images and streaming video, and providingvideo-over-Ethernet (ONVIF) images and streaming video.

In some embodiments, the scanner 208 alternates images taken usingnatural illumination and auto-exposure, with images taken using brightLED illumination from the scan field lighting 220 and fixed-exposure.The auto-exposed images may provide an overall view of a checkout laneand may be used to provide video security images over Ethernet to anetwork video recording system (NVR). The fixed-exposure images mayprovide a brightly illuminated, localized view of items as they arescanned, and may be used to read one and two dimensional barcodes.

FIG. 3 includes two series of images captured by an imagining devicewith lighting and exposure setting manipulations, conventionally andaccording to an example embodiment.

In situations where the work area is a product scanner scan-field, anissue is that high-performance imaging product scanners, such as thebarcode scanners like the REALSCAN 7879 BI-OPTIC IMAGER available fromNCR Corporation of Duluth, Ga. require bright, rapidly pulsing,localized illumination to capture 1D and 2D barcodes. This illuminationcauses image pulsing and flickering when viewed through conventionaloverhead cameras. Conventional cameras include UVC webcams,video-over-Ethernet security cameras, and the like. This pulsing andflickering is annoying to humans, and interferes with imaging algorithmsthat execute against captured images for purposes of fraud and theftdetection. For example, see the top row of images in FIG. 3. Theillumination in each of the five images is inconsistent and flickering.

Barcode scanning algorithms typically need images that are highlyconsistent from frame to frame. The images must not be affected byambient store light, which varies from store to store, and from minuteto minute. Image brightness and color accuracy must be constant. Thebest way to accomplish this is to provide intense and localized LEDcamera illumination, which overwhelms and effectively cancels variationsin ambient light. To avoid eye discomfort and comply with safetyregulations, this illumination needs to pulsed on and off insynchronization with scanner camera exposure. This reduces the effectivepercentage of time that the light is on, which reduces the apparentbrightness to the human eye.

Some product scanners already provide such localized illumination for 1Dand 2D barcode scanning. However, conventional overhead cameras cannotsynchronize with the product scanner's illumination pulsing resulting inoverhead camera image flicker such that the overhead images aregenerally unusable. At the same time, if the overhead camera were toprovide its own illumination, the overhead camera illumination willsimilarly interfere with product scanner barcode scanning.

Various embodiments therefore integrate a remote overhead camera withthe product scanner or other workspace illumination source such that theoverhead images do not flicker. Some embodiments may also include theoverhead camera utilizing an illumination system of the product scannerto control image quality and color rendering by adjusting lightingparameters. For example, some embodiments temporality changeillumination behavior of the illumination source when the overheadcamera needs a flicker-free, color accurate image, such as illustratedin the bottom row of images in FIG. 3. In some other exampleembodiments, one or more overhead cameras continuously synchronizeexposure and illumination through wired or wireless communication. Thewired communication may be a one, two, four, or other number of wiresthat connect each of the one or more cameras to a control module that isalso coupled to the lighting. Wireless communication may be conductedvia near-field communication (NFC), BLUETOOTH®, WI-FI®, or otherradio-based communication technology. The wireless communication mayalso be optical in some embodiments. In such embodiments, an overheadcamera may optionally shift its exposure time window to overlap withillumination pulses and provide a localized view of the scan-field, orto avoid certain illumination pulses and provide a larger generalizedview. The synchronization may be performed via the correspondingcommunication means of the particular embodiment.

Returning now to FIG. 2, one or both of the cameras 240, 242 may beplaced above the scanner 208 such as to provide overhead images. Thefirmware 226 or software 230 may provide control module functions to thescanner 208 and in doing so, temporality adjust illumination from thescan-field lighting 220 to allow one or both of the cameras 240, 242 tocapture images at certain times or at certain frame rates. This mayinclude illuminating lights of certain colors at certain intensities toprovide enable capturing of color-accurate images. This may also includeturning off all lighting such that an auto-exposure setting of one orboth of the cameras 240, 242 can be used. The cameras 240, 242 in suchembodiments may be off-the-shelf webcams.

In some such embodiments, the firmware 226 or software 230 of thescanner 208 or a process on a terminal, such as terminal 104 of FIG. 1,to which the scanner 208 is coupled, determines that an overhead view ofthe scan zone is needed. For example, in a self-checkout embodiment, thecustomer may have placed bananas on the scanner 208 scale 210 top platefor weighing, and pressed a terminal screen button labeled “selectproduce.” The terminal may then send a command to the scanner 208instructing the scanner 208 to turn off its illumination from the scanfield lighting 220 and to capture and return an overhead camera 240, 242image to the terminal. The scanner 208 captures the image and returnsthe image to the terminal, which then processes the image. For example,the terminal may determine that the item on the scanner 208 scale 210top plate is bananas based on color and shape, and then prompt thecustomer to press a terminal screen button labeled “Yes, this item isbananas.” or to select a particular variety of bananas (e.g., organic orotherwise). The terminal may then send a command to the scanner 208 toturn its illumination back on. Note however that in some embodiments thescanner 208 may automatically turn its illumination back on afterreturning the image to the terminal. Additionally, one or both of thecameras 240, 242 may instead be connected or otherwise communicatedirectly with the terminal or operate independently of the terminal.

In another embodiment, the scanner 208 and overhead camera(s) 240, 242may continuously synchronize exposure and illumination by electrical,radio, or optical means. Such embodiments do not disrupt scanning andprovides continuous images while taking full advantage of localizedscanner 208 illumination from the scan-field lighting 220. In some suchembodiments, the overhead camera(s) 240, 242 may be custom designed tobe integrated in such as manner for lighting synchronization with thescanner 208 or other lighting source.

In some of these embodiments, the terminal, such as terminal 104 of FIG.1, or scanner 208 determines that an image of the overhead view of thescan-field is needed. For example, in a self-checkout system, thecustomer may have placed some bananas on the scanner 208 scale 210 topplate for weighing and pressed a terminal screen button labeled “selectproduce.” The terminal may then send a command to the scanner 208 tocapture and send an overhead camera 240, 242 image to the terminal. Theoverhead camera 240, 242 is synchronized with the scanner 208 scan-fieldlighting 220. An image is then captured by the camera 240, 242, providedto the firmware 226 or software 230 process of the scanner 208 ordirectly to the terminal. Regardless, the terminal eventually receivesthe image and then processes the image. For example, the terminal maydetermine, from the processing of the image, that the item on thescanner 208 scale 210 top plate is bananas based on color and shape, andthen prompt the customer to press a terminal screen button labeled, “Yesthis item is bananas.”

This embodiment requires synchronizing the overhead camera 240, 242 withthe scanner 208 scan-field lighting 220. To perform thissynchronization, the scanner 208 may provide a sync output to theoverhead camera via a dedicated electrical wire pair. The scanner 208may be the “master” device for providing frame sync. The sync signal maybe a pulsed signal from 0V to 5V in some embodiments that indicates whento start a next exposure based on a change in the signal.

In some other instances of such embodiments, the camera 240, 242 may“free run” at approximately a same frame rate as the scanner 208. Thescanner 208 may monitor the timing of images sent from the camera 240,242 to the scanner 208 and actively synchronize the phase of the camera240, 242. In some such embodiments, the camera 240, 242 repeatedlytriggers its imaging chip to start the next exposure at a frame rateequal to that of the scanner 208. The camera 240, 242 trigger has anadjustable phase delay. For example, if the frame rate is 25 frames persecond, then the phase delay might be adjustable from 0 to 0.04 seconds.The scanner 208 measures the difference between the arrival time of theimages from the camera 240, 242, and the exposure start time for theimaging devices 218 (i.e., cameras) inside the scanner 208. If thedifference is greater than a threshold, then the scanner 208 may send acommand to the camera 240, 242 instructing the camera 240, 242 to adjustits phase delay to reduce the difference. For example, the thresholdcould be 0.004 seconds. If the scanner 208 determines that the camera240, 242 frames are arriving 0.02 seconds before the scanner 208 imagingdevice 218 exposure start time, then the scanner 208 would send acommand to the camera 240, 242 to increase the overhead camera phasedelay by 0.02 seconds. The process then repeats to keep thesynchronization. (Note that references herein to the scanner 208performing certain actions is reference to data processing activitiesthat are performed by execution of instructions in firmware 226,software 230 on the processor 222, or both).

The synchronization may be accomplished in some other embodiments byproviding a sync output from the camera 240, 242 to the scanner 208 viaa dedicated electrical wire pair. The camera 240, 242 in suchembodiments is the “master” device for providing frame sync.

In some additional embodiments, the camera 240, 242 may passively syncwith the scanner 208 scan-field illumination 220 by optically monitoringthe scan-field. The camera 240, 242 in such embodiments may use itscamera imaging chip, or a separate dedicated photodetector, to monitorthe scan-field. The camera 240, 242 may perform image or signalprocessing on the scan-field image data to extract a sync signal fromthe scan-field illumination. In some embodiments, the passive synchingmay include an installer running a software utility on the terminal thatshows a “live” view from the overhead camera 240, 242. If the overheadcamera uses the image sensor for detecting frame sync, the softwareutility allows the installer to draw a box around, or mouse-click or tapin the middle of, the scanner 208 scan-field. The location of thescan-field within the camera image may then be stored in the camera 240,242 for later use. However, if the camera 240, 242 uses a dedicatedfixed optical detector, the installer uses the live view to aim theoverhead camera 240, 242 so that the optical detector is in the middleof the scanner 208 scan-field. The camera 240, 242 in such embodimentsthen continuously performs image processing on the images, or performssignal processing on the signal from the fixed optical detector, todetermine the phase and frequency of the scan-field illumination fromthe scan-field lighting 220. If the camera 240, 242 uses the imagesensor for detecting frame sync, the camera 240, 242 limits its imageprocessing to the defined area as described above. The overhead camera240, 242 then synchronizes its exposure with the phase and frequency ofthe scanner 208 scan-field illumination and the process repeats tomaintain synchronization thereby forming a phase locked loop.

FIG. 4 includes a series of images captured by an imaging device withlighting and exposure settings as illustrated. An overhead camera(s) maybe called upon in some embodiments to alternate images captured with andwithout illumination. Images captured with illumination show the scanzone in sharp contrast to the background, and are more consistent inbrightness and color. Such images are useful for scanning barcodes andfor some fraud and theft detection image analytics. Images capturedwithout illumination show the general scene around the scan-field, butare typically inconsistent in brightness and color. Such images areuseful for security monitoring. As shown in FIG. 4, the camera cancontrol whether it captures images with or without scan-fieldillumination by phase shifting camera exposure time relative to thescan-field illumination.

FIG. 5 is a logical block flow diagram of a method 500, according to anexample embodiment. The method 500 is an example of a method that may beperformed on one or more of a product scanner, a terminal, a kiosk,within a camera, or on a combination thereof. The method 500 includesadjusting 502 at least one of an exposure setting of an imaging deviceand lighting within a field of view of the imaging device to affect anexposure within an image captured by the imaging device. The method 500further includes capturing 504 an image with the imaging device with theat least one of the exposure setting of the imaging device and thelighting within the field of view of the imaging device to achieve adesired exposure within the captured image.

In some embodiments, the adjusting 502 and capturing 504 are performedat a frequency at which a process is to receive images, such as a theftor fraud detection process, a security video recording process, and thelike. In some such embodiments, the method 500 includes forwarding thecaptured image to the process. Such embodiments may also includereturning at least one of the imaging device and the lighting that wereadjusted to either an original state or a next state in a sequence ofstates for capturing images.

The imaging device, in some embodiments of the method 500, is one of aplurality of imaging devices of, coupled to, or in communication with aproduct scanner. Also, the lighting may include at least one scan-arealighting element of the product scanner. In some embodiments, adjusting502 lighting within the field of view of the imaging device includesturning off lighting from all scan-area lighting elements of the productscanner.

In some other embodiments of the method 500, adjusting 502 at least oneof the exposure of the imaging device and lighting within the field ofview of the imaging device includes continuously synchronizing both theexposure and the lighting. Adjusting 502 at least one of the exposure ofthe imaging device and lighting within the field of view of the imagingdevice may also or alternatively include sending a signal via a wirefrom a device controlling the lighting within the field of view of theimaging device and the imaging device. In a further embodiment,adjusting 502 at least one of the exposure of the imaging device andlighting within the field of view of the imaging device includes sendinga signal via a sequence of light pulses from the lighting to the imagingdevice, the signal instructing the imaging device of at least one of aframe rate and an exposure setting to capture one or more images.

Capturing 504 the image with the imaging device in the method 500 mayinclude receiving the image from the imaging device. Some suchembodiments further include transmitting the image via a network to avideo recording process that stores the image as a video frame.

FIG. 6 is a block diagram of a computing device, according to an exampleembodiment. In one embodiment, multiple such computer systems areutilized in a distributed network to implement multiple components in atransaction-based environment. An object-oriented, service-oriented, orother architecture may be used to implement such functions andcommunicate between the multiple systems and components. One examplecomputing device in the form of a computer 610, may include a processingunit 602, memory 604, removable storage 612, and non-removable storage614. Although the example computing device is illustrated and describedas computer 610, the computing device may be in different forms indifferent embodiments. For example, the computing device may instead bea smartphone, a tablet, smartwatch, or other computing device includingthe same or similar elements as illustrated and described with regard toFIG. 6. Devices such as smartphones, tablets, and smartwatches aregenerally collectively referred to as mobile devices. Further, althoughthe various data storage elements are illustrated as part of thecomputer 610, the storage may also or alternatively include cloud-basedstorage accessible via a network, such as the Internet.

Returning to the computer 610, memory 604 may include volatile memory606 and non-volatile memory 608. Computer 610 may include—or have accessto a computing environment that includes a variety of computer-readablemedia, such as volatile memory 606 and non-volatile memory 608,removable storage 612 and non-removable storage 614. Computer storageincludes random access memory (RAM), read only memory (ROM), erasableprogrammable read-only memory (EPROM) and electrically erasableprogrammable read-only memory (EEPROM), flash memory or other memorytechnologies, compact disc read-only memory (CD ROM), Digital VersatileDisks (DVD) or other optical disk storage, magnetic cassettes, magnetictape, magnetic disk storage or other magnetic storage devices, or anyother medium capable of storing computer-readable instructions.

Computer 610 may include or have access to a computing environment thatincludes input 616, output 618, and a communication connection 620. Theinput 616 may include one or more of a touchscreen, touchpad, mouse,keyboard, camera, one or more device-specific buttons, one or moresensors integrated within or coupled via wired or wireless dataconnections to the computer 610, and other input devices. The computer610 may operate in a networked environment using a communicationconnection 620 to connect to one or more remote computers, such asdatabase servers, web servers, and other computing device. An exampleremote computer may include a personal computer (PC), server, router,network PC, a peer device or other common network node, or the like. Thecommunication connection 620 may be a network interface device such asone or both of an Ethernet card and a wireless card or circuit that maybe connected to a network. The network may include one or more of aLocal Area Network (LAN), a Wide Area Network (WAN), the Internet, andother networks. In some embodiments, the communication connection 620may also or alternatively include a transceiver device, such as aBLUETOOTH® device that enables the computer 610 to wirelessly receivedata from and transmit data to other BLUETOOTH® devices.

Computer-readable instructions stored on a computer-readable medium areexecutable by the processing unit 602 of the computer 610. A hard drive(magnetic disk or solid state), CD-ROM, and RAM are some examples ofarticles including a non-transitory computer-readable medium. Forexample, various computer programs 625 or apps, such as one or moreapplications and modules implementing one or more of the methodsillustrated and described herein or an app or application that executeson a mobile device or is accessible via a web browser, may be stored ona non-transitory computer-readable medium.

It will be readily understood to those skilled in the art that variousother changes in the details, material, and arrangements of the partsand method stages which have been described and illustrated in order toexplain the nature of the inventive subject matter may be made withoutdeparting from the principles and scope of the inventive subject matteras expressed in the subjoined claims.

What is claimed is:
 1. A method comprising: adjusting at least one of anexposure setting of an imaging device and lighting within a field ofview of the imaging device to affect an exposure within an imagecaptured by the imaging device; and capturing an image with the imagingdevice with the at least one of the exposure setting of the imagingdevice and the lighting within the field of view of the imaging deviceto achieve a desired exposure within the captured image.
 2. The methodof claim 1, wherein the adjusting and capturing are performed at afrequency at which a process is to receive images, the adjusting furtherincluding adjusting a phase of the imaging device to activelysynchronize a frame rate of the imaging device with the scanner.
 3. Themethod of claim 2, further comprising, forwarding the captured image tothe process.
 4. The method of claim 3, further comprising: returning atleast one of the imaging device and the lighting that were adjusted toeither an original state or a next state in a sequence of states forcapturing images.
 5. The method of claim 1, wherein: the imaging deviceis one of a plurality of imaging devices of, coupled to, or incommunication with a product scanner; and the lighting includes at leastone scan-area lighting element of the product scanner.
 6. The method ofclaim 5, wherein the imaging device is mounted above the productscanner.
 7. The method of claim 5, wherein adjusting lighting within thefield of view of the imaging device includes turning off lighting fromall scan-area lighting elements of the product scanner.
 8. The method ofclaim 1, wherein adjusting at least one of the exposure of the imagingdevice and lighting within the field of view of the imaging deviceincludes continuously synchronizing both the exposure and the lighting.9. The method of claim 1, wherein adjusting at least one of the exposureof the imaging device and lighting within the field of view of theimaging device includes sending a signal via a wire from a devicecontrolling the lighting within the field of view of the imaging deviceand the imaging device.
 10. The method of claim 1, wherein adjusting atleast one of the exposure of the imaging device and lighting within thefield of view of the imaging device includes sending a signal via asequence of light pulses from the lighting to the imaging device, thesignal instructing the imaging device of at least one of a frame rateand an exposure setting to capture one or more images.
 11. The method ofclaim 1, wherein capturing the image with the imaging device includesreceiving the image from the imaging device, the method furthercomprising: transmitting the image via a network to a video recordingprocess that stores the image as a video frame.
 12. The method of claim1, wherein the imaging device is a network-enabled video camera.
 13. Asystem comprising: a product scanner including at least one imagingdevice and a light-field that illuminates a scan-area; an overheadimaging device to be positioned to provide an overhead view of thescan-area of the product scanner; and a control module that controlsoperation of the product scanner and the overhead imaging device byperforming data processing activities comprising: adjusting at least oneof an exposure setting of the overhead imaging device and lighting ofthe product scanner light-field to affect an exposure within an imagecaptured by the overhead imaging device; and capturing an image with theoverhead imaging device with the at least one of the exposure setting ofthe overhead imaging device and the lighting product scanner light-fieldto achieve a desired exposure within the captured image.
 14. The systemof claim 13, wherein the adjusting and capturing are performed at afrequency at which a video recording process is to receive images, thedata processing activities further comprising: forwarding the capturedimage to the process; and returning at least one of the imaging deviceand the lighting that were adjusted to either an original state or anext state in a sequence of states for capturing images.
 15. The systemof claim 13, wherein adjusting lighting of the product scannerlight-field includes turning off the lighting.
 16. The system of claim13, wherein adjusting at least one of the exposure of the overheadimaging device and lighting of the product scanner light-field includescontinuously synchronizing both the exposure and the lighting.
 17. Thesystem of claim 16, wherein the synchronizing is performed by a processthat executes on the overhead imaging device sensing light pulse signalsoutput by control module from the lighting of the product scanner. 18.The system of claim 13, wherein adjusting at least one of the exposureof the imaging device includes sending a synchronizing signal to theoverhead imaging device.
 19. The system of claim 13, wherein thesynchronizing signal is sent via a wired connection between the controlmodule and the overhead camera.
 20. The system of claim 13, wherein thecontrol module is integrated within the product scanner.